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EXPLOITATION OF DISCONTINUITY INDICATOR FOR 
TRICK MODE OPERATION 

Cross Reference to Related Applications 

5 This application claims the benefit of U.S. Provisional Application Serial 

Number 60/488,835 filed on July 21 , 2003, the entirety of which is incorporated 
herein by reference. 

Government Rights in This Invention 
10 Not Applicable. 

Field of the Invention 

The inventive arrangements relate generally to video systems and more 
particularly to systems that perform trick mode operations on streams of multimedia 
1 5 content. 

Background of the Invention 

Multimedia content is often digitally encoded in a compressed format to 
minimize an amount of storage necessary to store the multimedia content and to 

20 minimize the amount of bandwidth necessary for propagating the multimedia content 
to content viewers. One digital compression format that is currently very popular is 
the Moving Pictures Expert Group (MPEG) format. Digital television broadcast 
systems typically stream MPEG encoded multimedia content to digital television 
receivers which decode the MPEG stream for presentation onto a display, such as a 

25 television. 

MPEG streams contain program clocl< references (PCRs) that are associated 
with each frame and delivered in what is called an adaptation field. PCRs are count 
values based on a local 27 MHz clock contained within an encoder - called a system 
time clock (STS) - that encodes the MPEG stream. The PCRs are used to 
30 synchronize a decoder's local system time clock (LSTC) with the STS of the 

encoder. MPEG streams oftentimes also contain a presentation time stamp (PTS) 
for each coded picture in the MPEG streams. The PTS indicates the Instant at which 
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an encoded picture or audio block siiould be removed from tlie receiver buffer, 
instantaneously decoded, and presented for display. 

When viewing multimedia content received in an MPEG stream, some viewers 
may wish to perform certain trick modes. A trick mode can be any playback of 

5 multimedia In which the playback Is not done at normal speed or in a forward 
direction. Examples of trick nnodes are fast-fonward, rewind, pause, etc. When a 
trick mode is to be performed on multimedia content decoded from an MPEG 
stream, it is recommended that the decoder ignore the PGR values and decode and 
display frames as they beconne available. 

10 To Implement this process, a DSM_trick_mode_flag is set to 1 within each 

packetlzed elementary stream (PES) of the MPEG stream that is processed during 
trick mode playback. When the DSM_trick_mode_flag is set to 1, it is generally 
recommended that the decoder neglect vbv_delay and temporaLreference values, 
and consecutively decode each picture, displaying it until a next picture is decoded. 

1 5 The vbv_delay is a 1 6 bit unsigned integer representing the number of 90 kHz clock 
periods between entering a picture's start code into a buffer and removing and 
decoding the entire picture. The temporaLreference value indicates an order in 
which MPEG Intra pictures, predicted pictures and bidirectional pictures (I, P and B 
frames, respectively) should be displayed. Some digital television receivers, such as 

20 Advanced Television Systems Committee (ATSC) receivers, do not follow the 

general recommendation, however. In consequence, such non-compliant receivers 
attempt to use the PTS and PGR values from the bitstream to decode and display 
video. Accordingly, these non-compliant receivers do not properly implement 
trickmode playback. 

25 

Summary of the Invention 

The present invention relates to a system and a method for modifying a 
stream of multimedia content to implement trick mode playback functions in MPEG 
receivers that do not follow general MPEG trick mode Implementation 
30 recommendations, such as Advanced Television Systems Gommittee (ATSG) 

receivers. The system can include a processor that sets a discontinuityjndicator In 
an adaptation field associated with a video frame. The processor also sets a 
substitute program clock reference (PGR) value in the adaptation field. The 
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substitute PGR value can be set to a value approximately equal to a presentation 
time stamp (PTS) of the video frame with which the adaptation field is associated. 
Additionally, the processor can insert an adaptation field with at least one video 
frame with which an adaptation field was not already associated. The processor also 
5 can remove at least one video frame from the stream of multimedia content. 

Adaptation fields associated with the rennoved video frame can be removed as well. 

Brief Description of the Drawings 

Preferred embodiments of the present invention will be described below in 
1 0 more detail, with reference to the accompanying drawings, in which: 

FIG. 1 shows block diagram of a system, which is useful for understanding the 
present invention. 

FIG. 2A shows a portion of an MPEG stream, which is useful for 
understanding the present invention. 
1 5 FIG. 2B shows a modified version of the MPEG stream of Fig. 2A. 

FIG. 3 shows an MPEG decoder synchronization circuit useful for 
understanding the present invention. 

FIG. 4 shows a flow chart useful for understanding an embodiment of the 
present invention Implementing fast forward playback. 

20 

Detailed Description 

The present invention relates to a method for perfonnlng trick mode 
operations using a digital television receiver which is not preconfigured for such 
operations. The trick mode operations are implemented by manipulating timing 

25 information within a delivered stream of multimedia content to control an amount of 
time each video frame (frame) within the stream is buffered. More particularly, 
adaptation fields can be added in a Moving Pictures Expert Group (MPEG) stream. 
Dlscontinuityjndicators in the adaptation fields can be set to indicate a discontinuity 
in the MPEG stream. Further, program clock references (PCRs) contained in the 

30 adaptation fields can be set to substitute values which cause playback of the MPEG 
stream to change In accordance with a desired trick mode, as is discussed below in 
further detail. Accordingly, trick mode playback functions can be implemented In 
MPEG receivers that do not follow general MPEG trick mode Implementation 
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recommendations, such as Advanced Television Systems Committee (ATSC) 
receivers. 

A block diagram of a system 100 useful for understanding the present 
Invention Is shown in Fig. 1. The system 100 can Include a display 190, a storage 
device 150 and an MPEG receiver 110. MPEG receivers are known to the skilled 
artisan. One such receiver is an Advanced Television Systems Committee (ATSC) 
receiver, which can also include the display 190 as an Integral element. In a typical 
arrangement, the MPEG receiver 1 10 can comprise a tuner 1 15 for selectively 
receiving an MPEG stream 120. For example, the tuner 1 15 can be 
communicatively connected to an antenna, a television cable system, the Internet, or 
any other device or system, which can provide the MPEG stream 120 to the tuner 
115. 

The MPEG receiver 110 also can include a user input 140 which can receive 
user Input commands, for example from a keypad, a remote control interface and/or 
any other user interface devices. The user input commands can be propagated to 
components within the MPEG receiver 1 1 0 which process the user commands. For 
Instance, the user commands can be propagated to the tuner 115. User commands 
also can be propagated to the storage device 150 to Initiate various storage device 
operations, such as data storage and trick mode operations. 

Additionally, the MPEG receiver 1 10 can Include an MPEG decoder 125 for 
decoding the MPEG stream 120 into uncompressed audio/video streams for 
presentation on the display 190. The MPEG decodei* 125 can include a 
synchronization circuit 130, which Is discussed in further detail with reference to Fig. 
3. Such MPEG decoders 125 are known to the skilled artisan. The MPEG decoder 
125 can be communicatively linked to a communications port 135. The 
communications port 135 can be any port suitable for bi-directional communication of 
MPEG streams between the MPEG receiver 1 10 and one or more other devices. 
For instance, the communications port 135 can be communicatively connected to the 
storage device 150, which also can include a communications port 155 that supports 
bi-directional communication of MPEG streams. In one arrangement, the 
communications ports 135, 155 can be IEEE-1394 (FIreWIre) ports or a universal 
serial bus (USB) ports which are operationally connected. 
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The storage device 1 50 also can comprise a processor 160 for processing 
MPEG streams, a data store 170 for storing MPEG streams, and a record/playback 
interface 165 for interfacing the data store 170 with other storage device 
components. The processor 160 can be a central processing unit (CPU), a digital 
signal processor (DSP), an application specific integrated circuit (ASIC), or any other 
processor suitable for processing MPEG streams. The data store 170 can be any 
storage, which can store MPEG data. For instance, the data store can comprise 
random access memory (RAM), flash memory, a magnetic storage medium (e.g. a 
hard disk drive), an optical storage medium, a magneto-optical storage medium, or 
any other suitable data store. 

In operation, the tuner 115 can be tuned to select the MPEG stream 120. In a 
first playback mode, the tuner 1 15 can propagate the MPEG stream 120 to the 
MPEG decoder 125, which then decodes the MPEG stream and forwards the stream 
to the display 190. In this playback mode the MPEG decoder 125 decodes the 
MPEG stream 120 at a rate commensurate with a nomnal playback speed. 

Using the storage device 150, a number of additional playback modes can be 
Implemented by the MPEG receiver 110. For instance, the storage device can be 
used to Implement trick mode playback and time-shifting. In this arrangement, the 
MPEG stream 120 can be communicated from the tuner 115, through 
communications ports 135, 155 to the processor 160, to the record/playback 
interface 165, and finally to the data store 170. (The decision to send the MPEG 
stream 120 to the storage device, rather than to the MPEG decoder 125 depends on 
the user command received at the User input 140.) The processor 1 60 associates 
an identifier with each frame within the MPEG stream 120. These frame identifiers 
can be inserted into the MPEG stream 120 before the MPEG stream 120 is stored to 
the data store 170. The frame identifiers can be a sequence of integers or any other 
type of identifiers suitable for identifying the frames. 

During trick mode playback, the processor 160 typically instructs the 
record/playback interface 1 65 to retrieve the MPEG stream 120 from the data store 
170. The processor 160 then can modify the MPEG stream to cause the MPEG 
decoder 125 to playback the MPEG stream in accordance with a desired trick mode. 
Referring to Figs. 2A and 2B, an example of MPEG stream modifications which can 
be Implemented to achieve a fast forward trick mode is shown. In the example, a 
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modified MPEG stream 250, shown in Fig. 2B, is derived from an original l\/IPEG 
stream 200, shown in Fig. 2A. To achieve fast forward play, a number of frames 210 
can be removed from the MPEG stream 200. For instance, frames 210-2, 210-3, 
210-4, 210-6, 210-7, 210-8 and 210-10 can be removed. Adaptation fields 215, 
5 associated with the frames, which were removed, also can be removed. Thus, 

adaptation fields 215-4 and 215-6 can be removed. Accordingly, frames 210-1 , 210- 
5 and 210-9, and adaptation fields 215-1 and 215-9 remain in the modified MPEG 
stream 250, as shown in Fig. 2B. Adaptation fields can be added for any frames that 
do not already have an associated adaptation field. Thus, In the present example 
1 0 adaptation field 21 5-5 can be added. 

The PGR values within the adaptation fields can be set to control the rate at 
which the synchronization circuit causes the modified MPEG stream 250 to be 
decoded by the MPEG decoder. For example, the PGR value in each adaptation 
field can be set with a substitute PGR equal to the PTS value contained in the frame 
15 with which the adaptation field is associated. Thus, in the example shown, the PGR 
value in adaptation field 215-1 can be changed from 1000 to 3003, the PGR value in 
adaptation field 21 5-5 can be set to 15015, and the PGR value In adaptation field 
215-9 can be changed from 25000 to 27027. The processor also can set a 
discontlnultyjndlcator to a value of 1 In each adaptation field prior to the frame being 
20 delivered to the MPEG decoder. The discontinuityjndicator indicates that there has 
been a discontinuity in the modified MPEG stream. When this occurs, the decoder 
must load the substitute PGR In the adaptation field Into a counter of the decoder 
130 which generates a local system time clock (LSTG), as is discussed in further 
detail with reference to Fig. 3. 
25 Referring to Fig. 3, a block diagram of the MPEG synchronization circuit 130 

is shown. The synchronization circuit 130 is a closed loop control circuit, which is 
typical for synchronization circuits contained in MPEG decoders. When the MPEG 
decoder receives a typical, unmodified MPEG stream, the MPEG decoder loads a 
first PGR 305 fronn the MPEG stream into a counter 310 clocked by a voltage 
30 controlled oscillator 31 5. In general, the voltage controlled oscillator 31 5 outputs a 
27 MHz system clock signal 320. A first PGR 305 Is used to establish an Initial count 
value which the counter 310 Increments in accordance with the system clock signal 
320 to generate an LSTG 325. When a next PGR 330 is received, it Is compared 
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against the LSTC 325 in a subtracter 335. The subtracter 335 outputs an error 
signal 340 representing a difference between the LSTC 325 and the value of the 
next PGR 330. If the value of the LSTC 325 output precisely matches the next PCR 
330, then the error signal 340 will have a value of zero, which indicates that the 
LSTC 325 is synchronous with a system time clocit (STS) of the encoder. Any 
differences between the LSTC 325 and the next PCR 330 will cause the error signal 
340 to have a non-zero value. The error signal 340 can be filtered by a low pass 
filter 345 to remove undesired harmonics and generate a control voltage 350. The 
control voltage 350 then is used as a control signal to adjust the frequency of the 
voltage controlled oscillator 315 and keep the voltage controlled oscillator 315 locked 
to the frequency of the system time clock. For instance, If the LSTC 325 has a value 
higher than the next PCR 330, then the control voltage 350 will cause the frequency 
of the voltage controlled oscillator 315 to decrease. This may be undesireable for 
fast motion playback. 

Since the values of the PCRs 305, 330 are used to synchronize a decoder's 
local system time clock (LSTC) with the system time clock of an encoder, the 
adaptation fields of the modified MPEG stream can be set to effectively disable the 
frequency adjustment process of synchronization circuit 130. In particular, setting 
the discontinuityjndicator in each adaptation field causes each substitute PCR to be 
loaded into the counter 310 as a new PCR 305, and thus re-set the LSTC 325 to the 
new substitute PCR value. Hence, the subtracter 335 will not receive a next PCR 
330 and will not generate an en-or signal 340. Accordingly, the frequency of the 
voltage controlled oscillator 315 will not decrease in response to the modified PCR 
values. 

Moreover, each substitute PCR value can be loaded into the counter 31 0 to 
establish the new LSTC 325 prior to its associated frame being delivered to the 
MPEG decoder. Thus, by the time the frame is delivered to the MPEG decoder, the 
time represented by the frame's PTS will already have passed. Accordingly, the 
MPEG decoder will immediately decode the frame and forward the frame to the 
display, without any added buffer delay. In consequence, the modified MPEG 
stream will be presented as a fast motion trick mode. 

A flow chart useful for understanding the present Invention is shown in Fig. 4. 
Beginning at step 405, the storage device can receive a fast forward command from 
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the receiver, for instance a fast forward command entered by a user. The storage 
device can searcli for a next frame to deliver based on the fast fonward speed, as 
shown in step 410. Proceeding to step 415, the storage device can examine the 
PTS of the next frame to deliver and create a substitute PGR in the adaptation field 

5 and set the discontinuityjndicator. Continuing to step 420, the storage device can 
deliver the adaptation field to the MPEG decoder, which causes the LSTC of the 
IVIPEG decoder synchronization circuit to be updated with the new substitute PGR 
value. At step 425, the storage device then can deliver the frame correlating to the 
adaptation field to the MPEG decoder. Referring to decision box 430, step 435, and 

1 0 again to step 410, the process can repeat until fast fonA^ard process is stopped. 

At this point is should be noted that while the foregoing describes the fast 
fonward trick mode, the present invention also can be used to implement other trick 
modes. For example, PGR values can be set to substitute values which are 
significantly lower than PTS values of associated frames. Accordingly, the MPEG 

1 5 decoder can be forced to buffer frames for a time period longer than with normal 
playback. Frames that are currently being displayed can be repeated until the 
frames in buffer are released to be decoded and displayed. It also should be noted 
that other and further embodiments of the invention may be devised without 
departing from the basic scope thereof, and the scope thereof is detemiined by the 

20 claims that follow. 



